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Abstract. We prove that if f/ C M" is an open domain whose closure U is compact 
in the path metric, and F is a Lipschitz function on dU, then for each /? G K. there 
exists a unique viscosity solution to the /3-biased infinity Laplacian equation 

/3|Vm| + AooM = 



on U that extends F, where AooU — |Vw|^^ J2 

In the proof, we extend the tug-of-war ideas of Peres, Schramm, Sheffield and Wilson, 
and define the /3-biased e-game as follows. The starting position is xq G U. At the 
/c*^ step the two players toss a suitably biased coin (in our key example, player I wins 
with odds of exp(/3e) to 1), and the winner chooses Xk with d{xk,Xk~i) < e. The 
game ends when Xk & dU, and player II pays the amount F{xk) to player I. We prove 
that the value u'^{xo) of this game exists, and that — u||oo — ^ as e — *■ 0, where u 
is the unique extension oi F to U that satisfies comparison with /3-exponential cones. 
Comparison with exponential cones is a notion that we introduce here, and generalizing 
a theorem of Crandall, Evans and Gariepy regarding comparison with linear cones, we 
show that a continuous function satisfies comparison with /^-exponential cones if and 
only if it is a viscosity solution to the /3-biased infinity Laplacian equation. 



1. Introduction 

Informally, the infinity Laplacian equation AqoM = is the properly interpreted 
Euler-Lagrange equation associated with minimizing the functional (m, X) ^ \\^u\\l°°{x) 
for X C R", and the operator 

n 

AooM := |Vm|"^ ^ U^iUx,x,U^j (1-1) 

is the second derivative in the direction of the gradient Vm = (m^.-)"^]^. It was introduced 

and studied by Aronsson in 1967 |Aro67[ IAro68j . but even the basic existence and 

uniqueness questions have proven difficult, largely because of the non-smoothness of 

solutions. Several approaches were developed to overcome this problem, including the 

notion of viscosity solutions (see |CIL92j ) and the method of comparison with cones, 

developed by Crandall, Evans and Gariepy [CEGOlj . It was only in 1993 that Jensen 

|Jen93j showed that if f/ C M" is a bounded domain, and F is a Lipschitz function on 

dU, then a continuous function u is a viscosity solution to A^oU = if and only if it is a 

so-called absolutely minimizing Lipschitz extension of F. Jensen also proved uniqueness 

in this setting. See |ArCJ04j for a survey of absolutely minimizing Lipschitz extensions. 
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Then, in their recent paper |PSSW09] , Peres, Schramm, Sheffield and Wilson introduced 
a new perspective by applying game theory to these problems. Using the game random- 
tug-of-war, they proved the most general existence and uniqueness results to date for 
solving equations involving the operator Aqo- See Section [7] for more references. 

In the present work, we consider an extension of the infinity Laplacian PDE, the 
biased version 



which is very natural both from game theory and PDE points of view. It appears, e.g., in 
|BEJ08j . which considers generalizations of (11. ip that are motivated by game theory, but 
does not prove any existence or uniqueness results. On the other hand, (11.21) is covered 
by a general existence and uniqueness theorem of Barles and Busca [BBOlj . proved by 
PDE methods under strong smoothness conditions on the boundary of the domain. Our 
work gives a much better understanding of the corresponding game (the /5-biased e- 
tug-of-war, where the coin is suitably biased) than [BEJOSj, and, using this, proves a 
more general existence and uniqueness result for (II. 2p than |BB01j . Our paper follows 
the general strategy of |PSSW09"] . but there are several new elements and difficulties 
that were not present in the unbiased case, partly because the connection to absolutely 
minimizing Lipschitz extensions is not there any more. The link between biased tug-of- 
war and the PDE is now given by a new characterization of viscosity solutions of (11.20 in 
terms of comparison with exponential cones. This comparison property also makes 
it possible to state and prove extension results beyond the setting of M", namely, in 
general length spaces. We now describe our results in detail. 

For any metric space X, we can define a new metric, the path metric d{xi,X2), as 
the infimum of the lengths of all continuous paths from xi to X2 which are contained 
in X. A metric space is called a length space if it is equipped with this path metric. 
Note that the closure of a bounded domain U C MP- is not necessarily compact in the 
path metric; an example is an infinite inward spiral. On the other hand, the union of a 
finite number of convex closed sets in R" is a compact length space. 

Given a length space X, some Y G X, a real function FonY, a small e > 0, and any 
p(e) > 0, the biased e-tug-of-war game is defined as follows. The starting position 
is Xq e X\Y. At the k^^ step the two players toss a biased coin which player I wins 
with odds of p(e) to 1, i.e., with probability p(e)/(p(e) + 1), and the winner chooses Xk 
with d{xk,Xk-i) < e. (Even if X C M"", the moves are measured in the path metric 
of X, not in the Euclidean metric.) The game ends when Xk G Y, and player II pays 
the amount F{xk) to player I. Assuming that the value of this game exists (defined and 
proved below), it is denoted by u^^Xq). 

In particular, for any fixed /9 G M, a /5-biased e-tug-of-war game is defined by 
assuming that the odds function satisfies the following: 



A^u + (3\Vu\ = 



13 fixed. 



(1.2) 



p{x) is a smooth function with p(0) = 1 and p'(0) = j3, 
whose logarithm is concave or convex. 



(1.3) 
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Note that if the probabihty for player I to win a coin toss is , then we have 

1 + ^(e) , ^, X p(e) - 1 , , 

A natural example is d{e) = l3e/2, but for reasons that will be explained shortly, the 
most important example for us will be 

Po(e) := e^^ and ^o(e) := tanh ^ = = ^ - ^ + 0(/3e)5 . 

Our main result is the following. For the definition of viscosity solutions, see Section [61 

Theorem 1.1. Let U C R" be an open domain with closure X = U compact in the path 
metric, and let F be a Lipschitz function on Y = dU . Fix G M. Then there exists a 
unique extension of F to X that is a viscosity solution of U.^) on U. This solution is 
the uniform limit of the value functions u'^{x) for the (3-biased e-tug-of-war games on X . 

Let us point out that, unlike for the unbiased equation, the compactness assumption on 
X cannot be dropped. For instance, equation (11.21) in M takes the form u" {x) + j3\u' {x)\ = 
0, so, ifX = [0,cx)), Y = {0} andF(O) = 0, then the functions = sgn(/3)A(l-e-l^l^) 
with A e M>o are all bounded extensions on X solving ( 11. 2p . These one- dimensional 
/3-exponential functions will in fact play a crucial role in the sequel. 

Definition 1.1. Given /3 G M, A > 0, and xq & X in a length space, we define 

C^ix) := sgn(/3)A(l-e-^'^(^-^)) >0, (1.5) 

C" (x) := sgn(/3) A (1 - e^'^^^"'^)) < . 

For any B eM, the functions C^^{x) +B and C~^{x) +B are called positive and negative 
f3- exponential cones centered at xq with "slope" A. 



Figure 1. The positive and negative /^-exponential cones for (3 > on 
M^, and the two shown together. 

In M" with the Euclidean metric d{x,y), a /^-exponential cone (11.51) solves (II. 2p away 
from xq. In M, the unique positive /^-exponential cone centered at and with values 
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Co^(O) = and Cq{1) = 1, namely Cq{x) = ^i^^-p , coincides on x G [0,1] with 

Cf (x) = ~Ji_i — 5 the negative /3-exponential cone that is centered at 1 and has those 
values at and 1. This function is easily seen to be the e ^ limit of the value function 
for the /3-biased e-game on X = [0, 1], Y = {0, 1}, with -F(O) = and F{1) = 1, where 
the optimal strategies are obvious, and the game-play is just a biased random walk. 

Definition 1.2. A function u : X \ Y — > M satisfies comparison with f3- exponential 
cones from above (CECA) if for any ^ CC X\Y (i.e., V is a hounded open subset of X at 
a positive distance from Y ), xq & X , l & {+, — } and B G M, whenever u{x) < C!j.^{x)+B 
holds on X E d{V \ {xo}), we also have u < C^^^ + B on the entire V . Comparison with 
(5 -exponential cones from below (CECB) is defined analogously. If both conditions hold, 
then u satisfies comparison with (3 -exponential cones (CEC). 

The following equivalence is a generalization of the main observation of [CEGOlj . 

Theorem 1.2. Given an open connected U C MJ^, a continuous function u : U — > M is 
a viscosity solution of U.2\) iff it satisfies comparison with (3 -exponential cones. 

Given this characterization of viscosity solutions. Theorem 11.11 is an immediate con- 
sequence of the following more general result. 

Theorem 1.3. Let X be a compact length space, with a specified closed subset Y G X 
and F a Lipschitz function on Y. Fix G M. Then there exists a unique extension of 
F to X that satisfies comparison with j3 -exponential cones on X \ Y ; it is the uniform 
limit of the value functions u"^ for the (3 -biased e-tug-of-war games on X . 

To prove convergence of the value functions m'^(x), one would like to compare them 
for different values of e. It is unclear how to do this in general, but it works for e and 
2e as follows. One can view the e-game in rounds: until one player wins two more coin 
tosses than the other. The results of these rounds can then be considered as moves in 
the 2e-game. The odds for player I to win a round is p(e)^ to 1; this is because the 
coin toss trajectories (T^ := number of flips won by player I minus those won by player 
II in k steps) that end with player I gaining the advantage of two flips are exactly the 
T/j I— >■ — Tfc reflections of the other trajectories, and each has probability p(e)^ times that 
of the reflected one. So, if we want to mimic the 2e-game exactly, we need p(e)^ = p(2e). 
The simplest solution of this equation is po(e) = e'^", which explains the special role of this 
odds function. More generally, if (11.31) holds, we will be able to show monotonicity and 
hence pointwise convergence of the value functions along dyadic subsequences en = e/2", 
which will be the first step towards full convergence in the sup-norm. 

Another manifestation of the special role of the odds function po(e) = e^^ and the 
corresponding bias 6'o(e) is the following. If we perform a biased random walk (X„)„>o 
on M with steps ±e, with bias 6'o(e) to the right, and u{x) := a(l — e~^^) is a one- 
dimensional /3-biased infinity harmonic function, then m(X„) is exactly a martingale. 

We now define the value functions Mj for player I, and Mjj for player II. A strategy 
for a player is a way of choosing the player's next move as a function of all previous coin 
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tosses and moves. Given two strategies, Sj for player I and Sjj for player II, we define 
the payoff functions F+{Si, Su) and F_{Sj, Sjj) as the expected payoff at the end of the 
game if the game terminates with probability one under these strategies. So, in this case 
they are equal. However, we let F_{Si,Sjj) = —oo and F+{Si,Sjj) = oo otherwise. We 
think of u] as the minimum that player I can guarantee being paid; on the other hand, 
player II can avoid having to pay more than the value u]j. More precisely, 

u] := supinf , 

Si ■Sii 

u]j := inf supF+(5/,5//) . 

These values are functions of the starting location x & X. Clearly, u]{x) < u\j{x). If 
they are equal, we say the game has a value, and denote it by u^i^x) := u'\{x) = u]j{x). 

The organization of the paper into sections is based on the following six main steps 
of the proof. For readers familiar with |PSSW09] . we point out in brackets the main 
differences compared to the unbiased case. 

(1) 6'(e)-lNFlNlTY HARMONICITY: The value functions u]{x) and u]j{x) are ^(e)- 
infinity harmonic (defined below). 

(2) Game value existence: The e-game has a value, i.e., ■u^(x) := u]{x) = u'jj{x), 
for any 9{e) G [—1,1]. [To ensure finite stopping times, the backtracking argu- 
ment now needs to be much more elaborate. In particular, the compactness of 
X is used in a crucial way.] 

(3) GoNVERGENCE: The pointwise limit p := lim^^oo u'^^'^" exists, provided con- 
dition fll.3p holds. [The advantage given to one of the players becomes greater, 
hence harder to control, in one of the so-called "favored" games in Section O] 

(4) GOMPARISON WITH /5- EXPONENTIAL CONES: 

(a) The value function m'^ approximately satisfies comparison with /^-exponential 
cones. [The proof requires that sometimes the weaker player pulls towards 
a target; this is a reasonable strategy again because X is compact.] 

(b) The approximate CEG property provides enough regularity to conclude that, 
under (11. Sp . ■u'^/^" converges not only pointwise, but also uniformly. [Improv- 
ing the convergence from pointwise to uniform needs the regularity because 
we are allowing a wider class of biases, not just the nicest example Po(e)-] 

(c) Any uniform subsequential limit lim„^oo w^" satisfies CEC exactly. 

(5) Uniqueness: Any extension m of F that satisfies comparison with /^-exponential 
cones on X\y is equal to the dyadic limit Ue,po- [Here it is important to consider 
the games with odds function exactly po(e)-] Hence all extensions u and all limits 

p are the same, independently of p(-) and e > 0. 

(6) Equivalence: In the R" function satisfies CEC if and only if it is a 
viscosity solution to (II. 2p . [This generalizes ^CEGOlj.] 

Finally, Section [7] collects some open problems. 
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In what follows, without loss of generality, we may assume that (3 > and e is small 
enough, hence the coin favors player I, and | < ^^-j^ < 1. 

We now define 6'(e)-infinity harmonicity, the discrete analogue of having a constant 
drift in the direction of the gradient, and prove Item (1) above. 

Starting from xq, if player I wins the first coin toss and moves to some Xi, then 
conditioned on this event, he now has a strategy that guarantees a payoff arbitrarily 
close to ■Uj(xi), but does not have a strategy that guarantees more. The same is true if 
player II wins the first coin toss, and moves to some Xi of his choice. The value 
of the first choice is between the infimum and the supremum of u] over the ball B^{xq), 
and can be arbitrarily close to these two extreme values. The same argument can be 
repeated for u'jj, and we obtain: 

Lemma 1.4. For all x in X\Y , both u] and u]j satisfy 

n^) = — o — ^^y> — n — ™ ^^y> ■ (^-6) 

□ 

We say that u is ^(e)-infinity harmonic if it satisfies equation (11.61) . Notice that the 
term e in "6'(e)-infinity harmonic" indicates both the bias and the size of the balls. 

The supremum of the possible increases in the e-ball around x is denoted by 5^{x) : = 
suPygB^(^) — u{x). Similarly, the supremum of the possible decreases is 5^{x) : = 
u{x) — 'm.iy(^B^{x) u{y). Notice that, for a 6'(e)-infinity harmonic function u, equation (11.61) 
implies that these values are related by the equation 

and we see that 6~^{x) < 6~{x). 

We will sometimes use the modified metric d^{x,y), which is e times the minimum 
number of steps of size less than e to get from x to y; ioi x ^ y this is e + e\_d{x, ?/)/eJ . 
Let us remark here that we use open e-balls for the steps because, in Section [3] , we will 
need that any 2e-step can be broken into two e-steps without touching Y in between. 

Whenever we write / = 0{g) for two functions, we mean that / < Cg, where the 
constant C G (0, oo) might depend on (3 and X, F, F. 

2. Game value existence 

We will always assume that X is a compact length space, F C X is closed, and 
F :¥ — ^ M is Lipschitz. 

Lemma 2.1. is the smallest 6{e)-infinity harmonic function bounded from below on 
X that extends F. More generally, if v is a 6{e)-harmonic function which is bounded 
from below on X and v > F on Y , then v >u\ on X . 

Similarly, u]j is the largest 6{e) -infinity harmonic function which is bounded from 
above on X and extends F. 
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Proof. From Lemma [1.41 we know that u} is 6'(e)-infinity harmonic. It is bounded below 
because player I can fix a ?/ G 1^ and adopt a "pull toward y" strategy which at each move 
attempts to minimize the distance of the game position to y. In an infinite series of coin 
tosses there will be a time when player I has won more tosses by the amount d'^{xQ, y)/e, 
therefore he can ensure that the game terminates. Hence Mj(xo) > infy F > — oo. Of 
course infy F > — oo because F is a Lipschitz function and Y is compact. 

Suppose V > F on Y. Suppose also that v is 6'(e)-harmonic and bounded below on 
X. In order to show that v > u} = sup^^ inf^^^ Su), we must show that for every 

Si there exists an Su such that v > F_{Sj,Sjj). We may assume that Sj is a strategy 
that ensures that the game terminates — otherwise F_{Si, Sn) = — cx) for some Sjj and 
the assertion is obvious. We select Su such that if player II wins the k^^ coin toss he 
moves to Xk where v{xk) < mfy^B,{xk^i) '^{u) + other words, he plays to "almost" 

minimize v. Now notice that = v{xk) + 62~'' is a supermartingale with respect to 
the filtration JF^ generated by the first k coin tosses and moves: 

nMklJ'k-i] < sup viy) + ( mf ^ viy) + ^)+^ 



v{Xk-l) + 



2 \yeB^{x,-,) 2V 2^= 

l-e{e) ^ ^\ 6 
2k 



6 S 
< v{xk-i) + 2^ = v{xk^i) + = Mk-i , 

where the equality follows because v is ^(e)-harmonic. 

Let r := inf{fc : Xk G Y}; we have assumed that Sj an Sjj are such that r < oo 
a.s. Since is a supermartingale bounded from below, an optional sampling theorem 
(proved by monotone convergence and Fatou's lemma) gives E[M^] < E[Mo] and we 
have 

F_{Si,Sn) = E[F{xr)] < E[v{xr)] < E[Mr] < E[Mo] = v{xo) + S, 
where 6 was arbitrary, hence M/(xo) < v{xq). □ 

Theorem 2.2. For X, Y, F as before, for any e > and 9{t) G [—1,1], we have u} = u]j, 
i.e., the e-game has a value. 

Proof. We know that u} < u'jj always holds, so we need to show u} > u]j. As in 
Lemma \2.1\ we know that u\i < supy F < oo. We let u = u'jj. Recall that 6~^{x) = 
^^VyeB^(x) '^(y) —u{x); we will use the shorthand notation 6k ■= 6~^{xk). We first assume 
that the infima and suprema in the definition of ^(e)-harmonicity are achieved for all 
X G X, and that > 0. Always achieving the extrema is of course unrealistic, especially 
since the balls B^{x) are open. However, this way the formulas will be simpler and the 
main ideas clearer — later we will remove these assumptions. 

For m G Z"*" U {oo}, a finite or infinite sequence {xi : < i < m) of possible e-game 
positions in X \ y is called a maximal chain if the following holds: u{xk+i) = u{xk) + 5fc 
for k < m, and if m < oo, then the chain cannot be continued, i.e., all points Xm G X 
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with u{xm) = u{xm-i) + 5^-1 are in fact in Y. Notice that u{xk^2) > u{xk+i) and, 
since the maximal value in B^{xk) was attained at x^+i, the point Xk+2 cannot be in 
B^{xk)- Similarly, Xj is not in B^{xk) for any j > k + 2. So, for every k ^ j we have 
d{x2k,X2j) > e, i.e., the open balls B^/2{x2k) are all disjoint. Now, since X is compact, 
there exists a finite covering of it by open e/4-balls. Each ball B^/2{x2k) contains one of 
these e/4-balls entirely, hence there are more e/4-balls in the covering than points X2k- 
Therefore, there is a uniform finite upper bound M = M(e) on the cardinality of any 
maximal chain {xq,xi,X2, ...,Xm-i}, which is independent of the starting point xq. 

We now choose 6 small enough so that p*'^^ < 60, where p = p(e). We let Aq := Y and 
for n > we let An := {x E X : 3z E ^n-i with d{z, x) < e and u{z) = supyg^^j-^) u{y) > 

Finally, A := Uf=o^n- 

Notice that xq is in A. For, if {xo,xi,X2, ■■■,Xm-i} is the maximal chain described 
above, then its length is at most M. The ^(e)-harmonicity condition for u and (11.71) 
imply inductively that 6m-i > p^^^^^o > P^^^^^^o > so Xm-i is in Ai and hence xq 
is in A. Similarly, every x ^ A satisfies < 

For each n, we let j„ := max{j < n : Xj E A} and f„ := Xj^; this is the last position 
in A up to time n. 

We need to show that there exists an Sj such that for every Su, we have F_{Sj, Sn) > 
u. To that end, we let Su be an arbitrary strategy and we let Sj be the following strategy 
for player I. When Xn is not in A and player I wins the coin toss he backtracks toward 
A by moving to a previous game position that is closer to f„. That is, he moves to 
any position in {xj^, xj^+i, ...,Xn-i} which is within e of Xn and is closer to f„ than x„. 
When Xn is in A, he maximizes u within A as much as possible. 

We let dn be the minimum number of steps of length less than e required to get from 
Xn to Vn by only moving to previous game positions. We define 

TUn := u{vn) + {n - dn) p^^ S . (2.1) 

We claim that m„ is a submartingale. 

Case I. We consider the case where Xn E A and so m„ = u{xn) + np^^S. 

1. If player I wins the coin toss, then his strategy determines that m„+i = u{xn+i) + 
{n + l)p^^5 = u{xn) + 5n + {n + l)p^^5 > m„ + 

2. a. If II wins the coin toss and moves to another position G A, then m„+i = 

u{Xn+l) + {n+ l)p*^(5 > u{Xn) - pSn + [u + l)p^5 > m„ - p6n- 

h. If he moves to a position outside of A, then rrin+i = u{xn) + {{n+ 1) — l)p^^6 = rrin- 
Thus, in this case m„ is a submartingale, since 

Case II. We next consider the case where Xn is not in A and m„ = u{vn) + {n — dn)p^^S, 
with dn > 0. 

1. If player I wins the coin toss, then his strategy determines that he moves at least 
one e step closer to Vn- Hence m„+i > u{vn) + (n + 1 — {dn — l))p^S = uin + 2p*^5. 
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2. a. If II wins the coin toss and moves to another position not in A, we have 

mn+i > u{vn) + ((n + 1) - {dn + = rrin. 

b. If II wins and moves back into A, then we have 

m„+i = u{xn+i) + {n + l)p^S 

> u(xn)- p5n + (n + l)p^5 

> u{Xn) + np^S > u{Vn) + {u — dn)p^d — rUn 

from the second to the third hne we used that Sn < p^~^S, since Xn ^ A, while in the 
third hne we used that there is a path between x„ and Vn with at most d„ steps, each 
outside A, hence having a value difference at most p^5. 
Altogether, in Case II we also have 

E[mn+l\Tn] > rUn ■ 

Hence m„ is indeed a submartingale. We let r be the first time a terminal state is 
reached. We have that for all n, E[m„/\r] > E[mo] = ^(a^o)- 
We now show that Er is finite, so that EF(a:T-) > u{xo). 

Whenever the game position is in A, there is an independent chance that player I will 
win the necessary tosses in a row (some number at most M) and end the game. So the 
number of steps in A is stochastically bounded by Mp, where p is a. geometric random 
variable with success probability {^-^^^^)^ ■ Consequently, the expected number of steps 
inside A is at most W^Mp] = M{j^^)^ . 

Each outside run is stochastically bounded by an independent random variable ^fc, 
the length of a random walk on the nonnegative integers started from 1 until hitting 0, 
where the probability of moving to the left is ^-^-^^ and to the right is ^— We know 
that E^fc = 

The number of runs outside A is bounded by the number of steps in A. This gives 

Et<E( ^ ik + Mp). 

k<Mn 

By Wald's Lemma we have that E^^^^^^^ < and so 

So Em^ > Emo = u{xq). 

Recall that we have seen that u{xn) > m„ — np^S for all by considering the path 
between Xn and Vn outside A. 

Summarizing, we have that 

EF{xr) > Errir - p^6 Er > mo - p^6T = u{xo) - p^ST . (2.2) 

Since S can be made arbitrarily small, we have EF(a;^) > u{xq) = u'\j{xq). Thus 
> u}j, and, in the case where the suprema and infima are achieved, we are done. 
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We now remove the assumption that the extrema are achieved, but still assume that 
60 = 6~^{xq) > 0. Recall that there is a uniform bound M = M(e) on the length of any 
sequence {xq, Xi, . . . , Xm-i} where d{xj, x^) > e for j > A; + 2. Let 5, 77 > be small reals 
such that 

5>(p + 2)r/ and (5o > + Mr^) . (2.3) 

Now, given Xk, choose Xk+i to be a point in B^{xk) with 

u{xk+i) > u{xk) + 6k- p*^"S • (2.4) 

We claim that u{xk+i) > u{xk) and u{xk+2) > u{xk) + 5fc, therefore d{xj,Xk) > e for 
j > A; + 2, and the sequence must reach Y in at most M steps. 

By ([LTD and ([231), we have 6k+i > p^\u{xk+i) - u{xk)) > p'^Sk - p^'^i]). This 
and the second inequality of (12. 3p give by induction that 

'5fe>P*'"'(<5 + (M-A;)r7). (2.5) 

Combining this and (12.41) gives u{xk+i) > u{xk) immediately. To show u{xk+2) > u{xk) + 
6k, we use (12. 4p twice to write u{xk+2) in terms of u{xk), then using (12. 5p for 5^+1 we 
arrive at the following inequality to verify: p^''~^~^(5 + (M — k — 2 — p)rj) > 0, which 
always holds by the first inequality of (12. Sp . and our claim is proved. 

This argument shows that if we now define the set A\= |J*1q A^hy Aq :=¥ and 

An := {x e X : 5+(x) > (n - 1)77), and 

3z G An-i with d{z,x) < e and u{z) > u{x) + 5^{x) — p"^^?]}, 

then Xo G A, and similarly, x ^ A implies 6^{x) < p^\5 + Mr]). 

The strategy for player I now will be the following: if x„ G A, say a;„ G Aj, then try to 
step to a point z G Ai_i with u{z) > u{xn) + Sn — p''~^ri; if x„ ^ A, then try to backtrack 
towards the last visit f„ to A, as before. We also slightly modify the definition (12. ip . 
and claim that now 

TTln := u{Vn) + {u - dn) P^'\S + Mf]) 

is a submartingale. The proof remains the same, with two small modifications. Firstly, in 
Case I.l, we have only u{xn+i) > u{xn) + Sn — p'^^f], but then {n + l)p'^^ {6 + Mr]) — p^^r] > 
np'^^ {6 + Mr]) still gives us what we need. Secondly, in Case II.2.b, the path between Xn 
and Vn now makes possible a value difference at most dnP^{5 + Mr]), but we changed 
the definition of m„ exactly in order to accommodate this difference. 

The proof is completed by noting that given e > 0, the term p'^^{5 + Mr])T in the 
present version of (12. 2p can be made arbitrarily small by choosing 5 and r] small. 

Finally, if 5o = 0, we fix ?/ G F and let player I pull toward y until a position Xq with 
5^{xq) > is reached or the game terminates. Note that the first such Xq encountered 
has u{xq) = u{xo). If Xq G Y, then F{xl) = u{xo), and player I achieved the payoff 
u{xo). If Xq G X\Y, then player I plays the above strategy with Xq replacing xq, and 
can achieve the payoff u{xq) = u{xo) in expectation. This concludes the prooL □ 
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Corollary 2.3. = = u|j is the unique bounded 9 [e] -infinity harmonic function 
agreeing with F on Y . 

Proof. By Lemma [271] we have that u] is the smallest such function and u'jj is the largest. 
By Theorem 12.21 they are equal. Thus the function is unique. □ 

3. u^/^" Convergence 

We seek to prove that m^^^" converges as n G N tends to oo. However, it is not the 
case that u^'''^" (x) is monotone for each x G X, so, as in [PSSWOO] . we define a new game 
that does possess this property, the biased Il-favored e-tug-of-war. In this game, player 
II has some advantages: if he wins the coin toss, he is allowed to choose the next game 
position in a ball larger than the usual one; otherwise he still has the option to slightly 
modify the move of player I, provided that his modification terminates the game. 

More precisely, the biased Il-favored e-tug-of-war is defined as follows. At the k^^ step, 
player I chooses Zk in B^{xk-i)- If player I wins the coin toss, then player II can choose 
Xk £ {B2t{zk) n y) U {zk}- In other words, he moves to Zk or terminates the game. If 
player II wins the coin toss he moves to a position in B2e{zk) of his choice. 

The value to player I of the biased Il-favored e tug-of-war is denoted by v". The value 
to player II of the correspondingly defined biased I-favored e tug-of-war game is denoted 
by In both cases, the bias is ^^-j^, favoring player I. 

As the names suggest, player I cannot do better in the Il-favored game than in the 
ordinary game. In other words, f < u}. This is because given any strategy for player II 
in the ordinary e-game, player II can follow it also in the Il-favored game, since for any 
z G B^{x) we have B^{x) C B2e{z). Similarly, player II cannot do better in the I-favored 
game than in the ordinary game (he cannot ensure a value that is smaller than the value 
in the ordinary game), so u]j < w^. Hence we have f < = < w^. Moreover, the 
following lemma holds: 

Lemma 3.1. If p{-) is log-concave, then, for any e > 0, 
If p{-) is log-convex, then 

Proof. The inequalities f < m*^ < w*^ were already shown above. We now prove f ^'^ < f 
for the case when p(-) is log-concave. The argument for w"^ < w"^^ is analogous. 

Given any strategy for player I in the Il-favored 2e-game, he can mimic it in the 
Il-favored e-game as follows. Whenever he would choose a target point z G B2e{x) in 
<S|*^, in the e-game he aims towards z until what we will call "a round": until one player 
wins two more coin tosses than the other. This person will be player I with odds p(e)^, 
as we explained in the Introduction (or as follows from the computation in Lemma [3.41 
below). Note that log-concavity implies that p(e)^ > p(2e), hence the odds for player I 
to win a round is larger than his odds for a single coin toss in the 2e-game. 
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Now, if player I wins the round, the game position will be 2;, or in F fl -64^ (-2) if player 
II ended the game during this round; otherwise, it will be within B4^{z), as is easily 
checked. Therefore, player II has at most as many choices if he wins the round as he 
had upon winning a coin toss in the 2e-game. Altogether, player I can do at least as 
well with this strategy as in the 2e-game, and we are done. □ 

Thus, if p(-) is log-concave, then (f^'^^")„ is monotone increasing, hence its pointwise 
limit exists, while if p(-) is log-convex, then lim^^oo 'U^'^''^" exists. However, a priori these 
limits could be +00 or —00 sometimes, may not be the same even if both exist, and 
could depend on p(-) and e. 

Lemma 3.2. Let e > 0. Then for each x E X and y eY , 

v\x) > F{y) - (2e + d'{x, ?/))LipyF. 

Such an expected payoff is guaranteed for player I if he adopts a "pull towards y " strategy 
which at each move attempts to reduce d'^{xk,y)- 

Proof. Given X — Xq G X and y E Y, the "pull towards y" strategy for player I in the 
Il-favored game ensures that the game ends almost surely in finite time r < 00, and that 
d'^{xn,y) is a supermartingale, except at the last step where player II may have moved 
the game position up to e farther from y even if player I won the coin toss. This implies 

E[d'{xr,y)] < d'{x,y) + 2e. 

Since F is Lipschitz on F, we get 

E[F{x,)] > F{y) - {d\x, y) + 2e)Lip^F . 

Since v'' is at least as great as the expected payoff under this pull toward y strategy, the 
lemma is proved. □ 

We define d'{X) — s\x\y^^ ,j.^^xd''{x\,X'2)- Since X has finite diameter (diamJ^) in the 
path metric, we have d'^{X) < 00; in fact, lim^^o '^^(-^) = diamX. 

Lemma 3.3. If x E X , y eY and d'^{x,y) = e, then 

u'{x) < F{y) + p{ef^^^/' e UpyF < F{y) + 0(1) e^'^^^'"^ e LipyF, 

with an absolute constant 0(1). 

Proof. Let u = u}. Let 7 = u{x) — F{y) > 0. (If 7 < 0, we are done). 

As in the proof of Theorem 12.21 we first assume that the infima and suprema in 
the definition of 6'(e)-harmonicity are always achieved. Then there is a path {x = 
Xo,Xi,X2, ■■■} of maximal ascent, i.e., for each k, we have u{xk) = sup^g^^^^.^ .^-) ^(2;). 
Since X is bounded, this sequence is finite and ends at some y' G Y. 

Let d be the minimal number of steps of size less than e required to get from x to y', 
i.e., d = d^{x,y')/e. So y' = Xn for some n > d. 
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We let 5k = u{xk+i) —u{xk) be the maximal possible increase of u in the e-ball around 
Xk- Recall that at each step, 6k > 5jt_i/p(e) and 6o > 7/p(e). So 6k > p{e)~^''~^^^'y, hence 

n—l d 

F{y') > u{xo) + Y.p{er'^'^'h > u{xo) + 5^p(e)-^. 

k=0 k=l 

On the other hand, d{y,y') < d^{y,y') <{d+ l)e, and since F is Lipschitz, we have 

F{y')<F{y) + {d+l)eU^yF. 
Combining these two inequalities and using u{xq) — F{y) = 7, we get 

d 

{d+l)eUpyF > 5^p(e)A > + l)p(e)-^ > (t/ + l)p(6)-'^^(^)/^7, 

fc=0 

and so 

p(e)rf^WAeLipyF>7. 
Thus, in the case where the infima and suprema are achieved, we are done. 

If the infima and suprema are not achieved, we fix 77, 5 > small enough for (12. 3p to 
hold, with our M = M(e) as before. (Note here that we had 7 > 0, hence also 5o > 0.) 
We now define our sequence {xo,xi,X2, ■■■} such that each Xk satisfies (12. 4p . Similarly 
to what we did after (12. 4p . we have 5^+1 > p^^{6k — p^'^^'^rf), which by induction gives 
6k+i > p"(^+^)5o -{k + l)p^^-^~^7]. Since 60 > 7/p, we get 

d-l d-1 

F{y') > u{xo) + 5^ (4 - p''-'v) > u{x,) + {p-^'^'h -{k + l)p''-'v) 

k=0 k=0 

d 

>u{x,) + Y,p-'l-d^p''v- 

k=l 

Since d < M, from this we get in the same way as above that 

p(e)d^(^)A g LipyF > 7 - Mp^^T] . 
Since rj was arbitrary, the proof is complete. □ 

Some version of the above lemma is probably valid also for w*^ in place of m*^, but we 
prove instead a weaker but more general bound for w'^, not using the boundedness of X. 

Lemma 3.4. If x & X and y & Y with d'^{x,y) = 77 G [e, 1), then, for small enough e, 
we have w^i^x) < F{y) + (LipyF + exp(4/?y^) sup^/gy F(t/')). 

Proof. In the I-favored game, let player II pull toward y. The probability that player I 
gets y/rj distance away from x before the game ends is at most O(y^), which can be seen 
as follows. Let k = [y^/ej — 1 and i = rj/e E Z_|_. Let _Ro = 0, and R^j = — J2i=i P~* 
for < j < k, and Rj = X^to P^ < j < £. Consider the one-dimensional game 
that starts at Rq, player I moves to the left with probability ^-^f^, player II moves to 
the right with probability ^— f^, and the end is r = inf{n : x„ = R^k or Xn = Ri}- 
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Let q be the probability that x^- = R-k- This upper bounds the probabihty that player 
I will get > {k + l)e distance away from x before the original (I-favored) game 
ends. The position in the one-dimensional game is a martingale, so = Exq = = 
qR-^k + (1 <l)R£- Hence 



where the last inequality uses that p(e) < 1 + 2[3e for e small. 

Now, since all points in Y which are less than k steps away from x have value at most 
Fijj) + fceLipyF, we have 

< F{y) + ^LipyF + ^exp(4/3^) sup F{y') , 

y'&Y 

and we are done. □ 
Proposition 3.5. H^;^ — m^Hoo = 0(e). 

Proof. We will closely follow the proof of [PSSWOOl Lemma 3.3]. 

We play a virtual ordinary game, and player I's strategy in the favored game will mimic 
his strategy in the virtual game so that the game positions stay close (within e of each 
other). More precisely, we first fix a strategy Si for player I in the ordinary e-game that 
guarantees an expected payoff of at least u] — e against any strategy of player II. (In other 
words, F_{Si, Sji) >u] — e for any Su.) Then, we will select a strategy Sf for player I 
in the favored game which does almost as well as Si, in the sense that for any strategy 
Sfj for player II, there will exist an Sn such that F_{Sf ,Sfj) > F_(5/,5//) — 0(e) > 
u] — 0(e), where the last inequality is by our assumption on Sj. Thus we will have 
v"^ > u] — 0(e). Combining this with u] > v*^ from Lemma [3. 11 we will have the desired 
result. 

We let the superscript JF denote positions in the favored game. We begin both games 
at the same position. In other words, we let x^ = Xq. Our strategy Sf will satisfy by 
induction that d{xf, Xn) < e for each n, as long as both games are running. 

Assuming this for some n, at step n + 1 player I chooses zfj^^ = Xn- In other words, 
he aims for the current state in the virtual game. 

If player I wins the coin toss, then xf^i = zfj^i = x„ (as long as the game has not 
terminated), and in the virtual game Xn+i is chosen according to Sj. Hence d{xn+i, Xn) < 
e, and thus d{xf^i,Xn+i) < e. 

If player II wins the coin toss, then he chooses some xfj^i according to his Sfj, sat- 
isfying d{xf_^_i,Xn) < 2e. Then, in the strategy Sn we are constructing, player II picks 
Xn+i such that d{xf_^_i,Xn+i) < e and d{xn,Xn+i) < e. 

So, the game positions stay "close" in either case. 

If the virtual ordinary game terminates before the favored game does, in Sf we let 
player I pull towards the terminal position of the virtual game. If the favored game 
terminates before the virtual one, then in Sjj we let player II pull towards the final 
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position of the favored game. We let r be the time the virtual game ends and let r-^ be 
the time when the favored game ends. 

Case I. If r = r-^, then Xr and are in Y with \xr — < and since F is 
Lipschitz, we have 

-F(xf^)| < eLip^F. 

Case II. If r < r-^, then Xr & Y while x-^ ^ F, but still d{xr,xf) < e. Player I 
continues by pulling towards Xr, and Lemma 13^2] tells us that the conditional expected 
value K[F{Xt.t) \ Xr] to player I of the Il-favored e-game thus played is at least 

F{xr) - (2e + d'{xr, xf ))LipyF > F(x^) - SeLipyF . 

Case III. If r-^ < r, then x^jr G Y and x^-j^ ^ Y. Let y = x^j- and z = x^-j^; recall that 
d{y, z) < e. By Lemma [3.31 we have 

u]{z) < F{y) + 0(1) e^^'^"^^ e Lip^F. 

Thus u'j{z) < F{y) + 0(e). Continuing from player I cannot do better than u^z), 
hence E[F(x^) | x^t] < F{x^r) + 0(e). 

Summarizing the three cases, r-^ < oo a.s., and 

EF(a;^^) + 0(e) > EF{xr), 

hence F_(5f , Sfj) > F_(5/, Sn) - 0(e), as desired. □ 

Proposition 3.6. \\w'' — u''\\oo = 0{^/e). 



Proof. The proof is identical to the proof of Proposition 13. 5[ except that for case II we 
use < F{y) +0{^/e) from Lemma [3.41 and for case III we use m'^ > f > F{y) — 0(e) 
from Lemma [3.21 □ 

Corollary 3.7. If the odds function p(-) satisfies U.3\} . then, for any e > 0, the following 
limits exist pointwise and are equal: 

:= lim v"^'^" = lim m^^^" = lim w'^^'^" . 



Proof. By Lemma [3.1[ either (f^''^")n or {w'^^'^")n is monotone. On the other hand, by 
Lemmas 13.21 and 13.41 both sequences are bounded. Therefore, at least one of these 
two limits exist pointwise. On the other hand, by Propositions 13.51 and 13. 6[ we have 
||i;e/2" _ ^e/2"||^ ^ as 77, ^ OO. Therefore, both sequences must converge to the same 
pointwise limit. This is also the limit for m*^/^", since it is sandwiched between those two 
sequences, by Lemma 13. 1[ □ 

Note that the uniform closeness of f "^Z^" and w'^/^" does not imply automatically that 
the limits in Corollary 13.71 hold in the sup-norm. Furthermore, at this point we do not 
know yet if for different e values and p(-) functions the limits the same. 
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4. Comparison with exponential cones 

Recall Definitions 11.11 and 11.21 from the Introduction. We will now show that the 
value function u'^ almost satisfies comparison with /^-exponential cones, and then that 
any uniform limit satisfies CEC. We may assume /3 > 0. We will write the exponential 
cones ( II. 5p centered at xq in the form (^{x) = C{d{x, xq)), with C(r) = ae~^'' + 6 (positive 
cones) or C(r) = ae^"^ + b (negative cones), where a < and 6 G M. 

Lemma 4.1. Let 0{-) satisfy 9{e) < /3e/2 + O(e^). Let z e V dd X \ Y and write 
V^ = {x : -Be(x) C V} for e > small enough. Let y9(x) = C{d{x, z)) he a [3 -exponential 
cone centered at z. If u'^ < ^ on {V \ V^) U {z}, then u*^ < ip + 0{tM/s) on V^, where 
M := supy F — infy F and s := d{z., dV). 

Proof. Starting the game at xq G K, we need to give a strategy Sn for player II such 
that for any strategy Si of player I we have F+{Si,Sii) < ip{xo) + 0{eM/s). 

First we suppose that (p is a positive cone. Note that infy F < u'^{z) < (f{z), and that 
we may assume that (p{z) < supy F, since otherwise the result is trivial. We can replace 

by a new cone that has the same value at z but is otherwise as small as possible (while 
maintaining u < ip on {V \V^) U {z}); proving the result for this ip will suffice. Clearly, 
the value of p on dBs-e{z) is at most supy F. Now, writing C{r) = ae~^'^ + h for this 
</9, since the difference between the values at z and dBs_^{z) is at most M, we have 
|a|(l - e'^^"""')) < M, hence |C"(0)| = |a|/3 = 0(M/s), after choosing e < s/2 and using 
s < diamX. (Recall that O(-) is allowed to depend on X.) 

Fix 6 > 0, and let Xk-i G and r = d{xk-i,z). Let Su be the pull toward z 
strategy: if r > e, then player II reduces the distance to z by almost e, enough so 
that C{d{xk, z)) < C{r — e) + 5/2*^; if r < e, then player II moves to z; note that 
C(0) < C(r - e) + 0{\a\(3e) = C{r - e) + 0{eM/s) in this case. Then, 

E[y,(x.)|J-.„i] < l±Mc'(r + e) + i^|^(^C'(r-6) + A + 0(eM/.)l|,<,}^ 

By our assumption on 6{e), we have i^!^|^e~^^ + ^— |^e^^ > 1 — 0{e^). Recalling a < 0, 
this gives us 

E[^(xfe)|J-fc_i] < ae-""" + b + ^-ae-'''0{e^)+0{eM/s)l{r<e} 

< ^(xk-i) + ^ + Oie'M/s)+OieM/s)l{r<e}- (4.1) 
We let r = inf |fc : x/^ V^e \ {^}}, and, for k < r, define 

Mk := ipixk) + ^ - Oie^M/s) k - 0(eM/s) l{.<e}|{j : < j < /c and d{xj,z) < e}| , 
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where the terms Oi^e'Mj s) and 0{eM/ s) are chosen larger than the similar terms in (14. ip . 
Hence is a supermartingale. In order for this to be useful, we need that we do 
not lose much with these error terms until we reach r. One might worry that having 
the weaker player pull towards a target raises some complications here, but fortunately, 
this is easily handled by X being compact in the path metric, as follows. 

Due to the strategy iS//, the number of j's with d{xj, 2;) < e is stochastically bounded 
by an exponential random variable with a uniformly bounded expectation, as long as 
(1 — 6{e))/2 is bounded away from 0, which we may assume, since /3 > is fixed 
and e ^ 0. Moreover, E[r] = 0{e~^) under this strategy, by the following argument. 
The bias is only 9{e) = 0(e), each step of player I increases the distance to z by at 
most one step, and the distance from any x E X \ Y to z is at most 0(l/e) steps, 
therefore the time r is stochastically dominated by the time it takes for a random 
walk ^(e)-biased to the right on the line segment {0, 1, . . . ,0(l/e)} to get from some 
vertex i to 0. This has expectation 0(e~^), uniformly in the starting point i, as follows 
e.g. from the commute time formula of electrical networks, see |LyP[ Section 2.6] or 
|Lov96t Section 4]. In our setting, if we consider the network on {0, 1, ... , 0(l/e)} with 
conductances C{j,j + 1) = p' , then the effective resistance between vertex and i is 
R{0 ^ i) = X]j=o P""*' then the formula says 

0(l/e) i-l 0{l/e) 

E,ro + Eor, = 2i?(0^0 J + 1) = 2 1] 0(1) 0{1) = 0{e-^) . 

j=0 j=0 j=0 

Since we have this uniformly in i, we also get P[r > /ce~^] < exp(— c/c) for some c > 0. 

On the other hand, (p{xk) is bounded. Thus Mk is uniformly integrable, and an 
Optional Stopping Theorem |Dur96t Section 4.7] gives 

E[ip{xr)] < E[Mr] + O ((e^-2 + e)M/s) < E[Mo] + 0{eM/s) = ip{xo) + 6 + 0{eM/s) . 

Since r < 00 a.s. is clear from Su, we have Xr E (y\ K) U {z}, so u''{xr) < ^{xr), hence 
Uji^o) < sup 5^ F_{Si, Sii) < supgj Eu}{xr) < sup 5^ E(p{xr) < (pixo) + 6 + 0{eM/s) for 
any xq G V^. Since S was arbitrary, we have = u]j < + 0{eM/s) on V^, as claimed. 
If C{r) = ae^^ + b, then player II pulls away from z and the same equations result. □ 

Lemma 4.2. Let 9{-) satisfy 9{e) > Pe/2 - 0(e2). Let z e V CC X \ Y and write 
= {x : -Be(x) C V} for e > small enough. Let f{x) := C{d{x, z)) be a j3- exponential 
cone centered at z. If u'^ > ^ on (V \ V^)U {z}, then > ^ — 0{eM/s) on V^, where 
M := supy F — infy F and s := d{z, dV) . 

Proof. It is the same as the proof of Lemma 14. we just have to reverse the roles of 
players I and II and the direction of all the inequality signs. The bound E[r] = 0(e^^) 
is even easier now, since the stronger player is pulling towards a target. □ 

We want to use the above approximate CEC lemmas for u"^ to prove that if they 
converge to some u, then u satisfies CEC exactly. But in order to be able to apply these 
lemmas, we need that if < (y9 (or > (f) on dV for V GG X \ Y , then this almost 
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holds also in V \V^. This continuity property is actually a simple consequence of the 
lemmas themselves: 

Lemma 4.3 (Uniform Lipschitz away from Y). Assume that \e{e)-/3e/2\ = 0{e^). Let 
xi,X2 & X \ Y with max{d{xi,Y)} = s. Recall M = supyF — infyF. Then, for any 
e > with 2e < min{d{xi, Y)}, we have \u''{xi) — u''{x2)\ < O ((i^(xi,X2) M/s). 

Proof. Assume d{xi, Y) = s. Let V = {X\Y)^, and take the positive /3-exponential cone 
ip{x) = C{d{xi,x)) centered at Xi with f{xi) = u''{xi) and inf : y E X \ V^} = M. 

Then C"(0) = 0{M/s), while, by Lemma [4.11 we have 

u'{x2) < ^{x2) + 0{eM/s) < ^(xi) + C"(0)rf(xi,X2) + O(eM/s) 

< u\xi) +0{d\xi,X2)M/s) . 

Similarly, from looking at a negative cone centered at xi and Lemma 14.21 we obtain 
that u''{x2) > u''{xi) — 0{d''{xi,X2) M/s), and we are done. □ 

Notice that we can now plug the Lipschitz bound of Lemma 14.31 into the proofs of 
Lemmas 14. II and 14.21 to get the same results with V CC X \ Y, any z & X \ Y inside or 
outside V, and s = d{z, Y). 

With the help of the regularity provided by Lemma 14.31 we can now show that the 
convergence in Corollary 13.71 is in fact uniform: 

Theorem 4.4. // the odds function p(-) satisfies then, for any e > 0, we have the 

uniform limits 

Ue.p = hm v^^'^" = lim u"^'^" = lim w^^'^" . 



Proof. Using Lemmas 13.21 and 13.41 at Y, and Lemma 14.31 inside X \ Y, we get that the 
sequence (u''''^")n is uniformly bounded and "asymptotically uniformly equicontinuous" : 
Vr7>035>0 and N eN such that whenever n > N and d{x, y) < 5 for some x,y E X, 
we have — < i]. The proof of the Arzela-Ascoli theorem goes through 

for such sequences, and our underlying metric space X is compact, hence there is a 
uniformly convergent subsequence of (m'^/^")„. Since the sequence has a pointwise limit, 
this limit must be uniform, as well. By Propositions 13.51 and 13.61 the limits for {v'^^'^")n 
and (w'^/^")„ are also uniform. □ 

We can also derive now the key property of subsequential uniform limits along any 
subsequence \ 0: 

Theorem 4.5. Any subsequential uniform limit u = lim„^ooM^" satisfies comparison 
with (3 -exponential cones in X , and hence it is continuous on X . 

Proof. Consider an open set V CC X \ Y with d{V,Y) = s, and a /^-exponential cone 
(f centered ai z E X such that u < ip on d(y \ {z}). We must show that u < ip on 
V. Fix S > 0. For n large enough, -u^" <u-\-6<(f-\-6on dV. For all x E V \ 
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there exists a y G dV such that Is — ?/| < e„. Note that is uniformly continuous 
on V, hence ip{y) < ip{x) + 6 if n is large enough. Also, by Lemma I4.3[ we have 
< u'^"{y) + 0(e„ ■ M/s), which is at most u'^"{y) + S for sufficiently large n. 
Summarizing, we have u''"{x) < u''"{y) + 5 < ip{ii) + 25 < ip{x) + ?>5 ioi x & V \ K„- 

By the extension of Lemma [4. II mentioned after Lemma [4.31 m*^" almost satisfies com- 
parison with the /^-exponential cone (y9 + 35 from above, hence u*^" < ip + ?>5 + 0{en - M / s) 
on V . Since 5 was arbitrary, we have u = lim„^oo < if on V. 

The proof that u satisfies comparison with /3-exponential cones from below is the 
same, except that the reference to Lemma 14.11 has to be replaced by Lemma 14. 2[ 

That CEC implies the continuity of u at points x & X \ Y is clear by following the 
proof of Lemma 14.31 Continuity at points x follows from Lemmas 13.21 and 13. 4[ □ 

5. Uniqueness 

Let us give an outline of the strategy for proving uniqueness, which will be somewhat 
similar to |PSSW09l Section 3.5]. If m is a continuous extension of F that satisfies com- 
parison with /^-exponential cones from above, then, provided that ^(e) is large enough, 
player I can more-or-less achieve a payoff u in the e-game. Similarly, if u satisfies 
CECB and 6{e) is small enough, then player II can more-or-less achieve u in the e-game. 
Putting these two parts together, we get that if u satisfies CEC, and the bias is exactly 
^o(e) = tanh(/3e/2), then both players can almost achieve u; more precisely, we get 
v'' < u < w^. This implies that u = Ue^p^, for any e. Therefore, all continuous CEC 
extensions of F are the same. 

Lemma 5.1. Let w : X — > M he continuous and satisfy comparison with 13 -exponential 
cones from above on X\Y . Suppose that 6{e) satisfies < ^"^^^^ ^'^'^ fix 5 > 0. 

Then, in I-favored tug-of-war, player I may play to make M^^r « submartingale, where 
:= w{xk) - 5/2'' and r := inf{fc : d{xk, Y) < 3e}. 

Proof. Let := {x G X : d{x, Y) > 3e}, and so r is the time to exit X^^. Let k < t; 
then G X^^, and for player II's proposal z = we have B2e{z) C X\y. 

We need to show that K[M{xk)\zk, J-'k-i] > M{xk-i). We are not assuming that 
suprema and infima of w over balls are achieved; however, player I may play so that 
E[w{xk)\zk,Tk-i] > ^-^sup^g52<(2)^(l/) + ^^^u^iz) - Jr. We let 

l + ^(e) l-9{e) , , 

p := sup w\y) and g := pH w\^z) . 

yeB2,{z) 2 2 

We will show using CECA that for all x G B^{z) we have q > w{x). Since Xk-i G B^{z), 
this will imply that E[w{xk)\zk, J^k-i] > q-jk> w{xk-i) - jk and E[M{xk)\zk,Tk-i] > 
w{xk-i) - ^ - ^ = Mfc_i, as desired. 

We know that w{z) < supy^Q^^(^^^w{y) = p. First we notice that if w{z) = p then 
q = p as well, and hence w{x) < sup^g^2,{^) '^{u) = 1 all x G B^{z), as we wished. 

Next we assume that p > w{z). We let V := B2eiz)\{z}. We will define a positive 
exponential cone f{x) = C{d{z, x)) centered at z, such that w{x) < ip{x) on x G dV. By 
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CECA we will have that this inequality holds on all of V. In addition, the exponential 
cone will be constructed so that (p{x) < q on x & dB^{z). Since v^(x) is increasing in 
distance from z, this will imply that for x G B^{z) we have w{x) < if{x) < q, as desired. 
To that end, we let C{r) := (1 - e"^'') + Notice that C(0) = w{z) and 



C(2e) = p, hence w{x) < C{d{x,z)) on x G dV. Furthermore, C(e) = +w{z) < 

— w{z)) + w{z) = q, by our assumption on 6{e). Thus (f has all the desired 
properties, and player I can play so that K[Mk\zk, J-'k-i] > Mk-i- □ 

Lemma 5.2. Suppose w : X — > M is continuous, satisfies comparison with P-exponen- 
tial cones from above on X\Y , and w < F on Y . Let 6{e) satisfy ^_^_l-0^ < ^^-j^- Then 
>w for all e > 0, where w'^ is the value of the I-favored e-game for player II. 

Proof. Fix 6 > 0, and let M^, t and X^*^ be as in Lemma 15. 1[ We know by that 
lemma that player I can play such that E[MfcAT] > Mq. Since we want to show that 
inf^^^ sup^^ F+(iS/, iS//) > w, we may assume that Sj is the above strategy of player I, 
while Sjj is a strategy that ensures that the game almost surely finishes (which exists 
by Lemma [2.11) . In particular, we may assume that r < oo a.s. 

Now, w^(xo) > K[w^{xr) — S2~'^] if Xr is reached under the above Sj and an almost 
optimal iS//. On the other hand, w^i^Xr) — S2~'^ = w{xr) — 62~'^ + — w{xr)) > 

Mr — Ae, where := supj^ ^^^^a^ (w — w"). Now recall that E[M^] > Mq = w{xo) — S. 
Altogether, we get that w^^Xq) > w{xq) — A^ — 5. 

Letting 5 = e, we have > w — A^ — e. We will show in the next paragraph that 
limsup^^pAe < 0, hence letting e — » gives that limsup^^Qw" > w. We know that 
< and so > lim sup^/v^g — "^j desired. 

Given any x G X \ X^^, let y G F be such that d{x,y) < 3e. Notice that a : = 
(LipyF) supy y/^Y i_e^-^i3d(l.y') < ^ because Y is compact. Now let C{r) := a(l — e~^^) + 
F{y), and ip{x) := C{d{x,y)), a /3-exponential cone centered at y. Then, for G F we 
have (p{y') > (LipyF)(i(|/, |/') + F{y) > F{y') > w{y'), where the last inequality is by 
assumption. This implies ip > w onX hj comparison with exponential cones from above. 
Thus w{x) < (p{x) < a(l — e~^^^) + F{y). On the other hand, w'^{x) > F{y) — 0(e), 
by to^(x) > v'^{x) and Lemma [3.21 Therefore, w{x) — w'^{x) < a(l — e"^'^'^) + 0(e) and 
limsup^^o-^e — 0) promised above. □ 

For functions satisfying CECB instead of CECA, we have the following analogue: 

Lemma 5.3. Suppose that v : X — > M is continuous, satisfies comparison with (3- 
exponential cones from below on X\Y , and v > F onY . Let 9{t) satisfy ^j^l-fi^ > ^"^4^' 
Then v"^ < v for all e > 0, where f is the value of the Il-favored e-game for player I. 

Proof. The analogue of Lemma 15.11 holds exactly, and then the proof of Lemma 15.21 
can also be modified, the only difference being that the reference to Lemma 13.21 giving 
w'^{x) > f^(x) > F{y) — 0(e) has to be replaced by Lemma [3.41 giving v'^{x) < w'^{x) < 
F{y) + 0{^e). □ 
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We can now put together the pieces to prove our main result: 

Proof of Theore'm \1.3[ By Theorem \AA\ if e > and p(-) satisfies (11.31) . then the se- 
quences M*^/^", f^/^", w^''^" all converge uniformly to some il^^p as n — oo. By Theo- 
rem U31 this Ue^p satisfies comparison with /5-exponential cones, and is clearly an exten- 
sion of F. On the other hand, if u is an extension that satisfies CEC, then playing the 
favored e-games with ^o(e) = tanh(/?e/2). Lemmas 15.21 and [5l3] give that < u < for 
any e > 0, hence u = Ue,po, for any e > 0. Consequently, all extensions u (in particular, 
all limits p) are equal to each other. Finally, we get the uniform full convergence 
— m||oo using the argument employed in Theorem 14.41 the entire family {u'^)e\o 
is uniformly bounded and asymptotically uniformly equicontinuous, hence any subse- 
quence has a uniform limit; but we already know that there is a unique uniform limit, 
so the entire sequence converges. □ 

6. Equivalence between viscosity solutions and CEC 

We are going to study the /3-biased infinity Laplacian equation (11.21) in M", which may 
alternatively be written as 

^u:= Dlu + pD^u = 0, (6.1) 

where u := V'u(x)/|| V'u(x)|| is the unit gradient vector; for Vu{x) = we define $m(x) : = 
0. This equation is quite degenerate, and it is not clear that the functions that one 
would like to call solutions are actually differentiable even once. The notion of viscosity 
solutions is a usual solution to this problem |CIL92] . 

Definition 6.1. Let U C M" 6e a domain. An upper semicontinuous function u is a 
viscosity solution of $u > in U, or, in other words, a viscosity supersolution of h6.1\) . 
if for every local maximum point x eU of u — w, where w is C"^ in some neighbourhood 
of X, we have $w(a;) > 0. Similarly, a lower semicontinuous function u is a viscosity 
solution of < 0, or viscosity subsolution of Ii6. if for every local minimum point 
X & U of u — w we have $w(x) < 0. ^4 function is a viscosity solution of = if it is 
continuous and both a viscosity supersolution and subsolution. 

We now prove Theorem 1 1.2[ The idea of such a statement, together with the strategy 
of the proof, come from |CEG01] : however, some of the details are quite different. 

Proof of Theorem \1.2[ We may assume that (3 > 0. We first prove that if u does not 
satisfy CECA, then D^u + PD^u > does not hold in the viscosity sense. 

Suppose we have some V CC U, Xq & U, and a /^-exponential cone (11.51) with l G 
{+, -}, such that u{x) < Q(,(x) + B = C{\\x - xo\\) on x e d{V \ {xo}), hnt3xeV 
with u{x) > C^^{x) + B. Then, for any smooth nonnegative function / : U — > M, if 
e > is small enough, then w{x) := C^^^{x) + B + ef{x) is a smooth function near x that 
satisfies u{x) > w{x), while u{x) < w{x) on x G d{V \ {xq}). Hence we may choose x 
to be a local maximum of u — w. We want to find an / so that Dlw{x) + f3D^w{x) < 
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holds. We will of course search for an / of the form f{x) = fo{\\x — Xo\\). Then, for 
lis — Soil = r, 

WS(r)-mr)) if C"(r) + e/i(r) < 0, 

We now have to distinguish between the two cases t G {+,—}• Suppose first that 
t = +; thus C"(r) = Ape''^'' > 0. Let i? > be so large that V C Br^xo), and /o be 
any smooth positive function with /o(r) < and /o(r) < for all r G {0,R). If e > 
is small enough, then C'{r) + ef^ir) > for all r G {0,R). Then the LHS of is 
negative at a; = x G l^, as we wished. 

The case t = — is similar. Now C"(r) < 0, so, if we choose /o such that fair) > and 
/o (r) < 0, then, for e > small enough, C'{r) + efQ(r) < for all r G (0, R), and hence 
the LHS of (16.21) is again negative at x = x. 

We show similarly that if u does not satisfy CECB, then it is not a viscosity subsolution 
of (16. ip . Suppose we have u{x) > C^g(x) + B = C(||x — xo||) on x G d(y \ {xq}), but 
3x eV with u{x) < C^q(x) + B. We now want w{x) := C^q(x) + 5 — e/(x) with / > 
and e > small, so that Dlw{x) + (3D^w{x) > holds. Writing /(x) = fo{r), 

\eU'M + ;3/i(r)) if C'(r) - e/i(r) < 0. 

One can easily see that if /o is a smooth positive function with sgn/Q(r) = — i and 
/q (r) > for all r G (0, -R), then the LHS of (16. 3p is positive at x = x G B^^xo), as we 
wanted. 

Turning to the other direction of the equivalence claimed in Theorem 11.21 let us 
assume that u is not a viscosity supersolution at u{0) = 0, where E U. That is, 
there exists a function w such that u{x) < w{x) near 0, with equality at x = 0, 
while D'^w{0) + f3Di,w{0) < 0. Since this inequality is invariant under rotations, we may 
assume that Vw(0) = (p, 0, . . . , 0) where p > 0. Then the inequality for w simply reads 
as Wx^,xiiO) + Pp < 0. So let q := Wxi,xi(0) < —Pp < 0, and fix some further values 
q < q < q* < —Pp. Writing x = XiCi + y, with y being perpendicular to the unit vector 
ei, for the Hessian matrix V^ty(O) we have 

{V^w{0){xiei + y),xiei + y) < qxj + K{\xi\\\y\\ + \\yf) < qxl + k\\yf, 

with some constants K and i^'; the first inequality holds because the Hessian gives a 
bounded bilinear operator, while the second holds because given e > 0, there is a large 
enough L such that xy + y"^ < ex^ + Ly"^ for all x,y > 0. From this and the Taylor 
expansion of w{x) at x = 0, we get 

u{xi,y) <w{xi,y) < pxi + ^ (^qxj + k\\y\\^'^ + 0{\xif + \\yf) 

< px, + ^xl + K*\\yf=:G{x,,y) (6.4) 
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in a neighborhood of (a;i, y) = (0, 0), with some constant K*. 

Consider the /3-exponential cone ^p{x) = C^{x) + B := A{1 — e~^"^~^l') + 5, with 
a choice of the centre z and the slope A that gives VipifS) = APe^^^\^^\{—z/\\z\\) = 
(p, 0, . . . , 0). In particular, z = {—Zq, 0, . . . , 0) for some zq > 0, and p = A[3e~^^^ . 
Then easy calculus gives VV(0) = diag(-A^2g-/32o^ ^^g-z^^o/^g^ _ _ _ ^ ^^e-/3^o/^Qj = 

diag(— ^, . . . , a diagonal matrix. 

We made this choice for ip because G{xi,y) has now the same gradient (p, 0, . . . , 0) 
at = (0,0) as V9, while its Hessian is V^G(O) = diag(g*, 2i^*, . . . , 2i^*), with 

q* < —f3p. Note that, in defining the cone ip, we still have a freedom of choice in zq and 
in B. We take zq smaller than the distance of from dU, and also so small that p/zq is 
much bigger than 2K*, and then choose A to make p = Aj3e~^^°. Then we take B such 
that v^(0,0) < G{0,0), but their difference is very small even compared to {Pp — q*)zQ. 
Then, if we take the Taylor series of ip — G around (0,0), the first derivatives are 0, 
but the second derivatives, both in the Xi and the other directions, are positive enough 
compared to how little bit negative (f — G at (0, 0) is, to ensure that at the boundary 
of the ball of radius Zq around (0, 0) we have ip — G > 0. That is, for V := ^^^(O), we 
have u{x) < w{x) < G{x) < (p{x) for x e dV, while u{0) = w{0) = G(0) > v^(0), hence 
CECA fails for u. 

The proof that if u is not a viscosity subsolution, then CECB fails, is almost identical 
to the above. We only need to change the direction of all the inequality signs, and thus 
can construct a negative cone for which CECB fails. □ 



7. Concluding remarks and open problems 

Explicit biased infinity harmonic functions. There are only few explicit infinity 
harmonic functions known even in the unbiased case: in two dimensions, u{x,y) = 
|a;|4/3 _ |y|4/3 jg Qj^g example, the argument function in a sector (in polar coordinates, 
u{r, 0) = 0) is another. See [AroSGj [PSSW09] for further examples. For the biased case, 
it remains a challenge to give any genuinely non-1- dimensional example. For instance, 
it is not difficult to show that in a sector, with constant and 1 boundary values on the 
bounding half- infinite rays, no extension can be just a function of the angle 0. 

Even if we do not have explicit solutions, we could have an efficient algorithm to 
compute the unique extension numerically. In the unbiased case, using the absolutely 
minimizing Lipschitz property, there is a simple algorithm computing the discrete in- 
finity harmonic extension on a finite graph, in polynomial time in the size of the graph 
|LLPU96l ILLPSU99] . The same idea can be used to approximate continuum solutions 
in |Obe05j . However, we do not know of anything like that in the biased case. 

Uniqueness questions. In what generality does uniqueness hold? For example, what 
happens if f/ = X\y is a bounded domain in M", but X is compact only in the Euclidean 
metric, not in the path metric? Or is there a unique extension in a sector of any angle, 
with constant and 1 boundary values on the bounding half-infinite rays? 
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When X is an arbitrary length space, Y C X is closed, and F is a bounded Lipschitz 
function on Y, there might be several bounded continuous extensions satisfying CEC, 
but, when /5 > 0, the "smallest" extension seems to be more canonical than the others. 
Is the pointwise infimum of all bounded CEC extensions finite and also a CEC extension? 
(For f3 < we should take the pointwise supremum.) A simple example is the half-line 
X = [0, oo) with Y = {0} and F{0) = 0, mentioned after Theorem ll.li There are 
infinitely many viscosity solutions, or equivalently, CEC extensions here, with pointwise 
infimum u{x) = 0. Now, if we strengthen Definition 11.21 for CEC to include comparison 
over all open subsets V C V C X \Y (bounded or not), then u{x) = becomes the 
unique such extension. This "best" extension is also singled out from the point of view 
of the game: it is easy to see that u'ji^x) = and M//(a;) = +oo for all e > 0, hence 
the game does not have a value in the strong sense we used in this paper, but there 
are some natural weaker versions according to which there is a value, u'^{x) = 0. For 
example, in the definition of u'jj, we could take the sup only over such strategies Si 
for which there exists some Sjj terminating the game almost surely, because we should 
not punish player II with a payoff +00 for player I forcing the game not to terminate. 
(There would be a similar change in the definition of u}, as well.) Another solution is 
to assign a payoff L G [—00, 00] to any non-terminating game play. This game will have 
a value function m^(x), which is constant for all L < 0, and some larger L-dependent 
CEC function when L > 0, so the L < case may be called canonical. 

So, we have the natural questions: in what domains is it true that the pointwise 
infimum is the unique extension that satisfies the stronger CEC condition, moreover, is 
the e — ^ limit of value functions in some or most of the weaker senses? 

Regularity of solutions. A major open problem in the unbiased case is whether 
infinity harmonic functions in MJ^ are in the class C^; see |CEG01l ICEOll lEYOSj . For 
topological reasons, the understanding is better in dimension 2, where solutions are 
known to be in C^'" |Sav05l lESj . for some a > 0. One cannot expect a much stronger 
result, such as C^, as shown by the example — All these proofs use comparison 
with cones; it would be worth examining how much goes through to the biased case, 
using comparison with exponential cones. Do we have better or worse regularity than 
in the unbiased case? 

Expected duration of game. Given X compact in the path metric, in the un- 
biased e-game, if both players play optimally, then the "local variation" 6~^{xn) = 
^^PyeB{xn,e)'^''iy) ~ W'{xn) is uou- decreasing in n, and thus it is not hard to see that 
the expected duration of the game is Ox(e~^). However, it is much less clear that a 
player can achieve an (almost) optimal payoff within a similar expected time, regard- 
less of what the other player does. This is closely related to a PDE stability question; 
let us formulate the exact connection in the unbiased case, where more information is 
available. 
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In |PSSW09] . the e-game with running payoff was introduced: in addition to our 
usual data X, Y, F, we have a continuous / : X — > M, and the payoff for player I, if the 
game ends at step r, is F{xr) + ^IZo fi^i)- It was shown that if X is compact, F is 
Lipschitz on Y, and minx / > or max^ / < 0, then the e-game has a value m^, which 
converges uniformly to a continuous function u that is the unique viscosity solution of 
the inhomogeneous equation AqoM = /, with boundary condition u\y = F. 

Proposition 7.1. Assume that X,Y,F are as in the previous paragraph. Then the 
following are equivalent: 

(1) For any 6,e > 0, in the standard e-tug-of-war, player I has a strategy that achieves 
a payoff at least u'' — 6 starting from any position Xq E X \ Y , and the expected 
duration of the game is at most C^e^^. 

(2) // fk is continuous with minx fk > ^ for all /c G N, converging uniformly to as 
k — > oo, then the viscosity solutions Uk to AqoMa; = fk converge uniformly to the 
solution of AooU = 0, with boundary value F. 

Proof. Assuming (1), fix a small 6 > 0, then choose 7] > smaller than S/Cs- If k 
is large enough, then rj > fk > 0. The reflected version of (1) tells us that, in the 
standard e-game, player II can make sure that the payoff is at most u'^ + S, and the game 
finishes within expected time C^e^^. The exact same strategy in the game with running 
payoff fk guarantees that the expected total payoff is at most u'' + 6 + Csfj < + 25, 
independently of the starting position. On the other hand, the running payoff favors 
player I, hence the total expected payoff is certainly at least u^. This, together with the 
result we quoted from [PSSWOQj . establishes (2). 

Assume now (2). Let = l//c, fix any 5 > 0, and let k be large enough such that 
the viscosity solution Uk satisfies \\Uk — m||oo < 5. Now, if e > is small enough, then 
the value function u], of the e-game with running payoff fk satisfies Hm^ — Ufc||oo < 5, 
again by jPSSWOO] . Furthermore, if e > is small enough, then the value function is 
closer than 5 to the viscosity solution u. Altogether, if k is large and then e > is small, 
then \\ul. — M*" I loo < 3(5. Therefore, there is a strategy for player II that guarantees that 
the payoff in the e-game with running payoff fk is at most m*^ + 45. Since the running 
payoff favors player I, the same strategy achieves a payoff at most + in the standard 
e-game. (Starting with the reflected version of (2), we get a good strategy for player I.) 
Now, what is the expected duration of this game? 

Since F is continuous on the compact set Y , and u is continuous on the compact set 
X, both are bounded in absolute value, say, by C < oo. Hence Im^^I is bounded by C + 
and our strategy guarantees that the payoff in the e-game with running payoff fk is at 
most C + 55. But then the payoff collected from the running payoff must be at most 
2C + 55, hence the expected duration of this game can be at most (2C + ^5)e-'^k. This 
implies claim (1) with a constant = (2C + 55)A;, where k = k{6). □ 

Very recently, Lu and Wang proved part (2) with PDE methods, when X is the closure 
of a bounded domain in |LuWj . It would be interesting to see a probabilistic proof 
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of (1). More importantly, no such bound is known for the biased case, not even C^e"^, 
with any exponent 7 < oo in place of 2. 

A polynomial bound on the expected duration would be helpful, for instance, in giving 
a polynomial time approximation scheme to compute biased infinity harmonic functions. 

Let us finally note that if we had such a bound, then we would not need to be so 
careful in Section [5] and consider the e-game with exactly ^(e) = tanh(/?e/2): if the 
game does not last long, then small errors in the super- or sub-martingality could not 
add up to too much. We used a similar argument in Lemmas 14.11 and 14.21 but there we 
did not have to bound the time till the very end of the game. 
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